Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use metrics package in the notebook. #2130

Merged
merged 979 commits into from
May 24, 2023
Merged

Conversation

nick863
Copy link
Contributor

@nick863 nick863 commented Mar 16, 2023

Description

This PR is a draft of how we will use the metrics package for calculation of metrics locally. I have also replaced the custom scripts for mltable generation by mltable mechanism.

Checklist

AliMahmoudzadeh and others added 30 commits November 21, 2022 12:17
* updated the notebook

* updated the e2e sample notebook

* removed test value

* linting

* removed unwanted cell

Co-authored-by: Ali M <amah@microsoft.com>
* Adding test for AML in a day

* Update tutorials-azureml-in-a-day-azureml-in-a-day.yml

* Update tutorials-azureml-in-a-day-azureml-in-a-day.yml

* Update tutorials-azureml-in-a-day-azureml-in-a-day.yml

* Update azureml-in-a-day.ipynb

* Adding tests for more tutorials

* Update azureml-in-a-day.ipynb

* Adding README files

* Update readme.py

* Update azureml-in-a-day.ipynb

* Added Description to all files

* Update README.md

* Update readme.py
…#1901)

* Updated automl regression notebook to work with the latest matplotlib

* Updated generate_workflows.py based on move to v1 folder

* Updated automl_env files for SDK 1.47.0
* Revert "Revert "Update v1 Many Models and HTS Notebook" (#1763)"

This reverts commit 13f44d0.

* fix PR comments

* added new line at end

* fix black issue

Co-authored-by: Rahul Kumar <rahulkuma@microsoft.com>
…on (#1904)

* renaming  multi-label image classification git workflow; correcting yaml name

* Updates in github workflows from PR (#1879) after running cli/readme.py

* Revert "Updates in github workflows from PR (#1879) after running cli/readme.py"

This reverts commit 3bdee93.

* Updates in github workflows after running cli/readme.py

* Updates in github workflows for model/job-model-as-output and model/job-model-as-input

* Removing workflows related to model-job-model-as-input/output
* Security scanner for Azure ML Compute Instance detecting malware and vulnerabilities

* Apply black formatting

* Apply doc template

* Address PR feedback

* Update doc

* Update README.md

* Address PR feedback
…age (#1895)

* Adding checks for k8 extension and check for attaching the compute to workspace

* Adding a note on the top of all the workflows about regenerating using python script

* Update header in the workflows

* Adding the template for account and container

* Update the resource names for November to recreate resources

* Adding some basic samples for autogenerated SDKv2 for TypeSript language
* Adding checks for k8 extension and check for attaching the compute to workspace

* Adding a note on the top of all the workflows about regenerating using python script

* Update header in the workflows

* Adding the template for account and container

* Update the resource names for November to recreate resources

* Adding some basic samples for autogenerated SDKv2 for TypeSript language

* Reformat the files to address the linting issue
Add metadata to cells for docs
* Rename automl-nlp-text-classification-multiclass-task-sentiment-mlflow.ipynb to automl-nlp-classification-multiclass-sentiment-mlflow.ipynb

remove text and task from the name

* Rename automl-nlp-text-classification-multiclass-task-sentiment.ipynb to automl-nlp-classification-multiclass-sentiment.ipynb

* Rename automl-nlp-text-classification-multilabel-task-paper-cat.ipynb to automl-nlp-classification-multilabel-paper-cat.ipynb

* remove classification in the names

* workflow file changes and README.md

* remove original workflow files with long name
* Update data.ipynb

* Update data.ipynb

* Update data.ipynb

* Update data.ipynb
Co-authored-by: Nikolay Rovinskiy <nirovins@microsoft.com>
* Update workspace sample notebook

* Fix errors in the sample notebook

* Update workspace.ipynb

* Update workspace.ipynb

fix code formatting

* update formatting>

* Update the sdk_helper to clear the hacks

* revert sdk_helper hacks

* Update workspace.ipynb

update ws name in the last cell for cleanup

* Update black formatting :*(

* Update kernelspec

* change to python310-sdkv2

Co-authored-by: Yisheng Yao <yishyao@microsoft.com>
* add metadata to cells

* delete comma
* Update cli-responsibleaidashboard-housing-classification.yml

* Update cli-responsibleaidashboard-programmer-regression.yml
* add wait() to delete deployment

* rename the endpoint name

* add back time string to endpoint

* reformat notebook code

* data.ipynb is not related to this PR, but
build failed due to the reformat requirement

* endpoint name number of char 3 to 32

* Update data.ipynb

* revert change to data.ipynb

* revert change to data.ipynb
*added preprocessing component/node in automl-pipelines example for sdk and cli
* Fix mlflow-for-batch-tabular notebook

* Wait for job to finish to download

* Update notebook

* Update path

* Fix format

Co-authored-by: nancy-mejia <namejia@microsoft.com>
* Fix custom output batch notebook

* Update format

Co-authored-by: nancy-mejia <namejia@microsoft.com>
* add metadata to another cell

* fix metadata

* fix syntax
@nick863 nick863 merged commit 67c0a10 into main May 24, 2023
12 checks passed
@nick863 nick863 deleted the nirovins/add_metrics_package branch May 24, 2023 02:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet